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Abstract 



In this paper, we introduce an iterative numerical method to solve systems of 
nonlinear equations. The third-order convergence of this method is analyzed. Sev- 
eral examples are given to illustrate the efficiency of the proposed method. 
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: 1 Introduction 

cn 

Let us consider the problem of finding a real zero of the nonlinear system Fix) = which 
F : 9ft n — > 9ft n . As notation throughout this paper, a G 9ft n will denote the true solution 
of the nonlinear system F(x) = 0. More precisely Newton's method may has used as the 
approximation of the following indefinite integral, arising from Newton's theorem [TJ, 

& : /M = SW) + / f'(t)dt, 

Jx n 

for nonlinear equation f(x) =0. Noor[2] by using the combination of midpoint quadrature 
rule and Trapezoidal rule for integral ([TJ) has introduced following iterative process for 
solving f{x) = 0, 

4/(x n ) . , 

Xn+1 ~ Xn f'(x n )+2f(^)^mrr {) 

where 

__ f( x n) 



f(x n y 

Now, corresponding to ([TJ), for nonlinear system F(x) = is written, Ortega[3], Hj: 



F(x) = F(x n ) + I F'(t)dt, 



then we can extend the discussion to solve system of nonlinear equations F(x) = 0, so 
similar to the following iterative process for solving F(x) = is obtain as, 

-l 

F(x n ), 71 = 0,1,..., 
where 

y n x n F (x n ) Fi^Xn). 

where F'^n)" 1 is the Jaccobian Matrix of the function F evaluated in xj.. we call this 
iterative process Midpoint- Trapezoidal Newton's method (MTN). In this paper, we analyze 
(MTN) in details and prove its third-order convergent theorem. Also, we have comparisons 
with some other variants of Newton's method by numerical examples. 

2 Description of the methods 

Let F : Q C 3? n — > 3? n be sufficiently differentiable function and a be a zero of the system 
of nonlinear equations F(x) = 0. From (j2J) as following 

F(x) = F(x n ) + f F\t)dt, (3) 

we saw in the previous section that by using rectangular rule for above integral, classical 
Newton's method (CN) is obtained as following 

•En+l F (x n ) Fi^Xn). 

where is the Jacobian matrix of the function F evaluated in x n . If an estimation 

of is made by means of the trapezoidal rule and x = a is taken, then 

w F{x n ) + -[F(x n ) + F{a)]{a - x n ), 
is obtained and a new approximation x n+ i of a is given by 

Xn+i = x n ~ 2[F'(x n ) + F'(x n+ i)]~ 1 F(x n ). 

For solving of the implicit form problem that this equation involve, we use the (n + l)th 
approximation of Newton method in right side, 

x n+1 =x n - 2[F'(x n ) + F'(y n )]~ 1 F(x n ), n = 0, 1, . . . , 

where 

Vn X n F (x n ) F^Xn). 



X 



n+1 



X r 



4 F\x n )+2F'{^^)+F'(y n ) 
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This iterative method will be called Trapezoidal Newton's method (TN). By using har- 
monic mean in Qand x = a is taken,we have 

. 2F(a)F(x n ) , 

and the following iterative approximation is obtained 

x n +i = x n - -F(y n )' 1 F(x n )~ 1 [F(x n ) + F(y n )]F(x n ), n = 0, 1, . . . , 

where is, 

y n x n F (x n ) Fi^Xn), 

this variant of Newton's method is called Harmonic Newton's method (HN). If the mid- 
point rule is used to estimate integral (jBJ) and x = a is taken, it is obtained one 

0^F(x n ) + F(^±^y a -x n ), 

then, by a approximation x n+ \ f a, 



3^71+1 ^Ti 



F' 



F(x r 



so, an alternative of Newton's method is obtained as following 



F(x n ), 71 = 0,1, 



where 



this variant of Newton's method is called Midpoint Newton's method (MN). 

Now, if the integral ([3]) is estimated using the combination of midpoint quadrature 
rule and Trapezoidal rule and by considering x = a, we have 



« F(x n ) + - 



F'(x n ) + 2F' 



+ F'(a) (a-x n ), 



so, a new approximation x n+ i of a is concluded as following: 



x n -\-\ x n 4 



F\x n ) + 2F' 



+ F'(a) 



F(x n ), 



by using again the (n+l)th iteration of Newton's method in the right side of this equation, 
the implicit problem is avoided. Then 



2-n+l X n 4 

is deduced, where 



F\x n )+2F' 



I ( %n Vr, 



+ F\y n ) F{x n ), n = 0,l,... 



(4) 



y n x n F (x n ) Fi^Xn). 

This iterative process is called Midpoint- Trapezoidal Newton's method (MTN). 

In the next section we prove that, (MTN) has third-order convergence. The conver- 
gence of the other variants of Newton's methods can be proved analogously. 
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3 Main result 



In this section the third-order convergence of Midpoint-Trapezoidal Newton's method 
(MTN) is proven by following theorem. 

Theorem 3.1 Let F : Q C 9ft n — > 9ft n ; is k-times Frechet differentiable in convex Q 
containing the root a of F(x) = 0. The Midpoint- Trapezoidal Newton's method ^> has 
third-order convergence. 

Proof: The Taylor's expansion for any x,x n G Q, [I]: 

F(x) = F{x n ) + F'{x n ){x - x n ) + ±F"(x n )(x - x n ) 2 

+±F®(x - x n f + ■■■ + ^ k \x n )(x - x n ) k + ■ ■ • , 

with x = a and defining e n = x n — a we have: 

F(a) = F(x n ) + F'{x n ){a - x n ) + ±F"(x n )(a - x n ) 2 

+|F (3) (« - ^n) 3 + • ■ ■ + ^ k \x n ){a - x n ) k + • ■ • , 
F(x n ) F (yX^Cn -\- 2i F (x n )(Q; Xn) 



For k = 3 and from F(a) = we have: 

F(x n ) = F'(x n )e n - ^F"{x n )el + ^\x n )el + 0(||e n || 4 ). 
From ([5]) we can write the product F'{x n )~ 1 F{x n ) as following: 

F\x n )- l F{x n ) = F'(x n )- 1 ( J P / (x n )e„ - ^F"(x n )e 2 n + 0(\\e n \\ 3 ) 



(5) 



or 



F / (x n )~ 1 F(a; n ) = e n - -F \x n )- 1 F" \x n )e 2 n + 0(||e„|| 3 ) 



(6) 



From iterative process of (MTN) (jlj) we have: 

e n+l 



■>,.-> (-!j_JLl) . /.-' (// , 



F'(x n ) + 2F' (^±y^ + F '(y n )] e n - AF{x n ) . 

(7) 

To continue we need the Taylor's expansion of F'(x n — 8F'(x n ) 1 F(x n ))e n as following: 

F (-^n ®F {x n ) F (x n ))e n F (x n )c n OF (x n )F (x n ) F , (x n )c n 

+ ^ 2 F( 3 )(x n )(F'(x n )- 1 F(o; n )) 2 e n + 0(||e n || 4 ) 

by using ([6]) in above equation, we can write: 

F'(x n - 0F'(x n )- 1 F(x„))e n 

= F\x n )e n - 9F"{x n )(e n - \F \x n )~ l F" '(x n )e 2 n + 0(||e n || 3 ))e n 

+ \9 2 F^(x n ) (e n - \F'{x n )- l F"{x n )e 2 n + 0(||e n || 3 )) 2 e n + 0(||e n || 4 ) 



after some manipulation we obtain: 

F'(x n -9F'(x n )- 1 F(x n ))e n 

= F(x n )- 1 e n - 6F"(x n )e 2 n + lF"(x n )F'(x n )- 1 F"(x n )e 3 n (8) 

+ ei F m {Xn y n + (\\e n r), 

using (|Sj) for = | and 6 1 = 1, it is obtained, respectively: 

F'(5*±Ka) = F'(x n - |F'(x n )- 1 F(x n ))e n 

= F'(x n )e n - \F"[x n )el + ii^O^'M'^'M^ (9) 
+ |^ (3) (^)e^ + 0(||e n || 4 ), 

and (for 8 = 1) 

F'{y n ) = F'{x n - F'{x n )F{x n ))e n = F\x n )e n - F"{x n )e 2 n 

+ \F"{x n )F'{x n y l F"{x n )el + \F^{x n )el + 0(||e n || 4 ). [W) 

by using ((SD,© and ( flOl) . we can write right hand of Eq. (GO) as following: 

(F'(x n ) + 2F'(^) + F'(y n ))e n - 4F(x„) 

= <{V(x„)e„ + 2{F\x n )e n - \F'\x n )e 2 n 

+ \F"{x n )F'{x n y 1 F"{x n )el + §F( 3 )(x n )4 + 0(||e„|| 4 )) 
+ {F\x n )e n - F"(x n )e 2 n + \F"{x n )F'(x n )- l F"{x n )el 

+\F^\x n )el + 0(||e n || 4 )) J - A^F'(x n )e n - \F"{x n )e 2 n + JjF^ } 

= F"(x n )F'(x n )- 1 F"(x n y n - ±F^(x n )e 3 n + 0(||e n || 4 ) 
= (F"{x n )F'{x n )- x F"{x n ) - ±F^(x n )yi + 0(||e„|| 4 ) 

so using deduced result, from Eq. (j7j) we obtain: 

(f'(x„) + 2F'(^) + F'(j/ n ))e»+i 

= (FWFW- 1 ^) - ^F( 3 )(x„)) e 3 + 0(||e n || 4 ). 

this prove that the order of convergence is three, then the proof is complete. □ 

4 Numerical examples 

In this section we will check the effectiveness of MTN (jlj) and other iterative meth- 
ods in section [2j All computations are done by using mathematica, stopping criteria 
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X 



n+1 



x n \\ + ||F(x„)|| ^ e is used for computer programs. We use e ^ 10 



-14 



a 



e Xl .e X2 + Xi cos(x 2 ) = 
%i + x 2 - 1 = 0. 



, s . xi + 2x 2 -3 = 
[C)< > 2x 2 + x 2 -5 = 



(b) 



(d) 



x. 



2x\ 



3 ln(xi) 

- X\X 2 - 







5 Xl + 1 = 



J \n(xj) -2m(cos(x 2 )) =0 



(e) 



(5) 



Xi + e 3 " 2 — cos(rr 2 ) = 
3^1 — x 2 — sin(x 2 ) = 



cos(x 2 ) — sin(xi) 
(*3) X1 - i = 



(/) 



/v»2 _|_ ™2 _i_ ~,2 — q 

X\.x 2 .x 3 — 1 = 
Xi + x 2 



4 = 



(h) 



x x _ 



,1 ■} 







x 2 x 3 + x A (x 2 + x 3 ) = 
Xix 3 + x 4 (xi + z 3 ) = 
X\X 2 + x 4 (xi + x 2 ) = 

XiX 2 + XiX 3 + X 2 X 3 



= 1 



Approximations of XiS for examples (a)-(e) 



Table 1 



F(x) 


x 


Method 


Approximated solution 


Iteration 


Error estimation 


(a) 


(1,2) 


CN 


(46.61144449, -45.61144449) 


9 


9.33 x 10" 15 






TN 


(-4.38161975,5.38161976) 


5 


9.10 x 10~ 14 






MN 


(-12.92527753, 13.92527753) 


6 


3.55 x 10~ 15 






HN 












TMN 


-16.44481890, 17.44481890 


6 


1.64 x 10~ 14 


(b) 


(3.4,2.2) 


CN 


(5.26375932,5.71748439) 


10 


7.99 x 10" 15 






TN 


(5.26375932,5.71748439) 


7 


6.21 x 10" 15 






MN 


(5.26375932, 5.71748439) 


7 


4.44 x 10" 15 






HN 


(5.26375932, 5.71748439) 


8 


4.44 x 10~ 15 






MTN 


(5.26375932, 5.71748439) 


8 


8.88 x 10" 15 


(c) 


(1.5,1) 


CN 


(1.48803387,0.7558306) 


5 


9.99 x 10 _ie 






TN 


(1.48803387,0.7558306) 


4 


9.99 x 10~ 16 






MN 


(1.48803387,0.7558306) 


4 


9.99 x 10~ 16 






HN 


(1.48803387,0.7558306) 


5 


9.99 x 10" 15 






MTN 


(1.48803387,0.7558306) 


4 


9.99 x 10" 16 


(d) 


(0.2,0.2) 


CN 


No convergence 










TN 


No convergence 










MN 


No convergence 










HN 


No convergence 










MTN 


(0.95480414,6.58498148) 


8 


1.33 x 10" 15 


(e) 


(-1,-3) 


CN 


(2.1378 x 10- ib , 3.207 x lO" 16 ) 


457 


6.22 x 10 _ie 






TN 


(4.817 x 10~ 18 , 7.221 x 10~ 18 ) 


28 


1.21 x 10~ 27 






MN 


(-2.471 x 10~ 17 , -3.707 x 10~ 27 ) 


8 


4.85 x 10~ 2 






HN 


(6.715 x 10~ 17 , 9.107 x 10~ 17 ) 


53 


2.77 x 10" 22 






MTN 


(-1.364 x 10" 17 , -2.046 x 1)~ 17 ) 


49 
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Approximations of XjS for examples (f)-(h). 



Table 2 



F(x) 


Xq 


Method 


Approximated solution 


Iteration 


Error estimation 


(f) 


(2,2,0.5) 

\ 7 7 / 


CN 


(-2.090295, 2.140258, -0.223525) 


8 


8.88 x 10~ ie 






TN 


(-2.090295, 2.140258, -0.223525) 


5 


8.88 x 10~ 16 






MN 


(-2.090295, 2.140258, -0.223525) 


5 


9.02 x 10" 16 






HN 


(-2.090295, 2.140258, -0.223525) 


6 


1.78 x 10~ 15 






MTN 


(-2.090295, 2.140258, -0.223525) 


5 


9.02 x 10- 16 


(<?) 


(-2.5,1,1) 


CN 


(0.909569, 0.661227, 1.575834) 


10 


6.82 x 10~ 14 






TN 


No convergence 










MN 


(0.909569, 0.661227, 1.575834) 


5 


8.48 x 10~ 14 






HN 


No convergence 










MTN 


No convergence 






(h) 


(0.5,0.5,0.5,0.2) 


CN 


(0.5773, 0.5773, 0.5773, -0.2886) 


5 


2.22 x 10" iB 






TN 


(0.5773, 0.5773, 0.5773, -0.2886) 


4 


1.11 x 10~ 16 






MN 


(0.5773, 0.5773, 0.5773, -0.2886) 


4 


1.11 x 10" 16 






HN 


(0.5773, 0.5773, 0.5773, -0.2886) 


6 


1.31 x 10~ 13 






MTN 


(0.5773, 0.5773, 0.5773, -0.2886) 


4 


1.11 x 10" 16 



References 

[1] J.E. Dennis, R.B. Schnable, Numerical Methods for Unconstrained Optimization and Non- 
linear Equations, Prentice Hall, 1983. 

[2] M.A. Noor, New iterative methods for nonlinear equations, Appl. Math. Comput.(2006), 
doi:10.1016/j.amc:2006.05.146.. 

[3] J.M. Ortega, Numerical Analysis. A Second Course, SIAM, 1990. 

[4] J.M. Ortega, W.C. Rheinboldt, Iterative Solution of Nonlinear Equations in Several Vari- 
ables. Academic Press, Inc., 1970. 



7 



